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Extended AbstraclE] 
Abstract 

In this work we study of competitive situations among users of a set of global resources. 
More precisely we study the effect of cost policies used by these resources in the convergence 
time to a pure Nash equilibrium. The work is divided in two parts. In the theoretical part 
we prove lower and upper bounds on the convergence time for various cost policies. We then 
implement all the models we study and provide some experimental results. These results follows 
the theoretical with one exception which is the most interesting among the experiments. In the 
case of coalitional users the theoretical upper bound is pseudo-polynomial to the number of 
users but the experimental results shows that the convergence time is polynomial. 



1 Introduction 

General goal of the current work is the study of competitive situations among users of a set of 
global resources. In order to analyze and model these situations we use as tools, game theoretic 
elements [OR94j , such as Nash Equilibria, congestion games and coordination mechanisms. 
Every global resource debit a cost value to its users. We assume that the users are selfish; ie. 
their sole objective is the maximization of their personal benefit. An Nash equilibrium (NE) 
is a situation in which no user can increase his personal benefit by changing only his or her own 
strategy unilaterally. 

More specific, we are interested in the KP-model or parallel link^ model with n users(jobs) 
and m edges (machines) and we study convergence methods to pure Nash Equilibria, in which 
all the strategies a user can select are deterministic. Generally, a game has not always a pure 
Nash equilibrium. Although we are going to study cases in which there is always at least one 
Nash equilibrium. We define as cost policy of an edge the function which computes the cost 
of each user of this edge. 



2 Framework 

One method of convergence in a pure Nash equilibrium is, starting from an initial configura- 
tion, to allow all users to selfishly change their strategies (one after the other) until they reach a 



^The complete thesis is available, in greek format only, here: http://users.uoa.gr/~vfisikop/projects/thesis.pdf 
^Read |Kon06| for a survey on algorithmic problems in parallel links model. 
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pure Nash equilibrium. We are interested in the convergence time to pure Nash Equihbria, that 
is the number of these selfish moves. Firstly, we study the makespan cost policy, in which each 
edge debits its total load to everyone that use it. In the most simple case, the whole procedure 
is divided into several steps. At each step, the priority algorithm choose one user from the set 
of users that benefit by changing their current strategy. For this model, named ESS-model, 
the convergence time is at the worst case exponential to the number of users. We present the 
effect of several priority algorithms to the convergence time and results for the major different 
cases of edges (identical, related, unrelated) jEDKMOS] . 



Another approach, with applications to distributed systems, is the concurrent change of 
strategies (rerouting) |EDM05] in which more than one user can change simultaneously his 
strategy. This model is more powerful than ESS because of its real life applications but we are 
not analyzing it in this work. 



An extension to ESS-model is that of coalitions, in which the users can contract alliances. 
This model comes from cooperative game theory. In this case we have to deal with groups 
of users changing selfishly their group strategies. We restrict our attention to coalitions of at 
most 2 users in the identical machines introduced in |FKS06] . The pairs of coalitional users 
can exchange their machines making a 2-flip move as a kind of pair migration. There is a 
pseudo-polynomial upper bound to the convergence time to NE in this model. 



Another model of convergence, a little different than the others stated above, is the construc- 
tion of an algorithm that delegates strategies to the users unselfishly without increasing the 
social cost. Informally, social cost is a total metric of the system performance depending on 
the users strategies. This model is named nashification and the algorithm nashify provides 
convergence to a pure Nash equilibrium in polynomial number of steps without increasing the 
social cost |FGL+n3| . 



As far as the coordination mechanisms are concerned, they are a set of cost policies for the 
edges, that provides motives to the selfish users in order to converge to a pure Nash equilibrium 
with decreased social cost. 



In this paper, we study the effect of coordination mechanisms in the convergence time. We 
study the following cases: 

Cost Policies: (1) Makespan, (2) Shortest Job/User First (SJF), (3) Longest Job/User 
First (LJF), (4) First In First Out (FIFO). 

Priority Algorithms: (a) max weight job/user (maw), (b) min weight job/user (miw), (c) 
fifo, (d) random. 

Note that each machine uses a cost policy and the next for migration user is chosen using 
a priority algorithm and the above combinations can result in linear, polynomial or exponential 
convergence. 

In the concept of coalitions there is a need of tight braking when we have to choose among 
pairs of users. We study two algorithms: 

Coalition Priority Algorithms: (i) max weight pair (map), (ii) min weight pair (mip). 

Note that there is a arrangement of pairs comparing the subtraction of weights for each pair. 
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3 Results 



The paper's results are divided in two categories: theoretical and experimental. 

Theoretical Results. We study the convergence time for SJF, LJF and FIFO policies. 
Especially for FIFO we prove in identical machines case a tight linear bound and a pseudo- 
polynomial bound in unrelated machines case. 

2 

Lemma 1 Under the FIFO cost policy in the ESS-model, there is an upper hound of \wmax 
steps for convergence to NE in the unrelated machines case and n — 1 steps in the identical 
machines case. This result is independent from the priority algorithm. 

Proof Sketch. Note that in every step the cost of at least one user will be decreased so 
the cost of each user will not be increased. Also there is a potential function that decrease at 
least one unit at each step (under the integer weights assumption). Combining this with the 
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max potential P{0) < \wmax where Wmax the maximum weight we have the desired bound for 
unrelated machines. In the identical machines case we only have to observe that when a user 
migrates then it has no benefit to migrate again. This is true because at each step the minimum 
load did not increase so our result holds. □ 

Lemma 2 Under the LJF (SJF) cost policy in the ESS-model, the miw(maw) priority algorithm 
gives an upper bound of n steps for the identical machines case. 

Proof Sketch. Similar with the FIFO policy we have to prove that when a user migrates 
then it has no benefit to migrate again. Let = {1,2, ... ,n} the set of users sorted by not 
increasing weight order and Af = {t + 1, . . . , n} the set of users with weight greater or equal to 
that of user t. We prove the desired result by induction to the number of steps. □ 

In |ILMS05] there is a proof of a quadratic upper bound to the convergence time of unrelated 
machines using LJF and SJF policies but only for a restricted case. However, our experiments 
provide us with exponential lower bounds for the general case. 



Experimental Results. We implemenlj^ all the above mentioned models and analyze them 
experimentally. 

The main usage of this analysis is to provide us with lower bounds. In our experiments 
there are 3 parameters: the priority algorithm, the cost policy, and the priority algorithm of 
coalitions. The following weight distributions are used: 

(a) user's 10% have weight 10"/-^'^ and 90% have weight 1. 

(b) user's 50% have weight lO"/"*^*^ and 50% have weight 1. 

(c) user's 90% have weight and 10% have weight 1. 

(d) random distribution from the set [1, 10"/^*^]. 

(e) each user has as weight his/her id {wi = 1,W2 = 2, . . . ,Wn = n). 

In all cases the experimental results follows the theoretical with one exception which is the 
most interesting among the experiments. In the case of coalitions with at most 2 users the 
theoretical upper bound is pseudo-polynomial to the number of users but the experimental 
results shows that the convergence time is polynomial. Especially the experiments has shown 
that the number of 2-flips is quadratic using mip algorithm and linear using map algorithm 
(Figures [sj [4]) . In addition to that, the 2-flips are a large percent of the total migration steps 
so we can conjecture that the pseudo-polynomial theoretical upper bound can improve to a 
polynomial one. 

^The code in C is open and available here: 
http://users.uoa. gr/~vfisikop/projects/thesis_code/kp_velt.c 
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Figure 1: Maw algorithm with SJF pohcy and 
weight case (d) and (e) (y axis in logarithmic 
scale) 




Figure 2: Miw algorithm with LJF policy and 
weight case (d) and (e) (y axis in logarithmic 
scale) 




Figure 3: Maw algorithm with Makespan pol- 
icy using mip algorithm for coalitions and 
weight case (d) 

4 Conclusions 



Figure 4: Maw algorithm with Makespan pol- 
icy using map algorithm for coalitions and 
weight case (d) 



Identical Machines. The linear convergence is achieved when the priority algorithm bene- 
fits from the cost policy and chooses sequences of migrating users in order to satisfy the property: 
"a user is stabilized after his migration" . In makespan and SJF policies this obtained by the 
maw priority algorithm. In LJF policy this obtained by the miw priority algorithm. In FIFO 
policy this is obtained by any priority algorithm. Additionally, FIFO has the advantage that 
each machine doesn't need the knowledge of its users' weights, which is useful in applications 
in which the users don't have the knowledge of their weights. 

The exponential convergence in identical machine case is achieved when the priority algo- 
rithm operates "against" the machines' policy. Intuitively, this happens because the algorithm 
chooses the most "unstable" user for migration. In SJF (LJF) policies this obtained by the 
maw(miw) priority algorithm. 

Table 1 sums up the results of convergence time to NE for the identical machine case. The 
lower bounds are constructed from the experiments (see for example figures [l]and[2]). The upper 
bounds for FIFO, SJF, LJF policies are lemmas [T] and [2] and the results for Makespan policy 
are taken from |EDKM03| . 

Unrelated Machines. In this case the upper bounds are either exponential or pseudo- 
polynomial and FIFO policy seems to be the best again. Table 2 sums up the results of 
convergence time to NE for the unrelated machine case. 
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Table 1: Lower and upper bounds of convergence time to NE for the identical machine case. The 
results for Makespan policy are taken from jEDKM0"3] . 
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Table 2: Lower and upper bounds of convergence time to NE for the unrelated machine case. The 
results for Makespan policy are taken from jEDKM03] . 

5 Future Work 

As a possible extension one can study other cost policies and priority algorithms and compare 
with the existing ones. The above models can be studied under the concept of price of anarchy. 
Is a good cost policy under the convergence time to NE concept also good under the price 
of anarchy concept? What is FIFO's price of anarchy? The cases of related and unrelated 
machines have also many open problems. Finally in games among coalitions it is interesting to 
study coalitions with more than 2 players. 
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